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List of Abbreviations 

BJT— Bipolar Junction Transistor 
CL— Confidence Level 
DSEE— Destructive SEE 
JFET— Junction Field Effect Transistor 

MOSFET— Metal-Oxide-Semiconductor Field Effect Transistor 

RLAT— Radiation Lot Acceptance Test 

SEB— Single-Event Burnout 

SEE— Single-Event Effect 

SEGR— Single-Event Gate Rupture 

SEL— Single-Event Latchup 

SOI— Silicon on Insulator 

TID— Total Ionizing Dose 

RPP— Rectangular Parallelepiped 

WC— Worst Case 
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Radiation Hardness Assurance (RHA) Assumptions 


Total Ionizing Dose (TID) Hardness 
Assurance Assumptions 



Single-Event Effect (SEE) Hardness 
Assurance Assumptions 

- Poisson errors on event counts dominate 

- Part-to-part and lot-to-lot variation in 
SEE response (usually) negligible 

• Destructive SEE (DSEE) may be exception 

- Charge collected defines SEE response 

- Mitigation: Large event counts minimize 
Poisson errors on cross sections 

- Rate constant; can happen any time 



- Dominant errors from sampling due to 
part-to-part and lot-to-lot variation 

- Mitigation: Increase sample size and/or 
understand failure mechanisms and 
variation 

- Failures tend to cluster around mean 
failure dose 
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Radiation and Reliability 
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How do radiation errors/failures compare to reliability issues? 
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Current RHA and RHA Statistical Models 


Because radiation testing is destructive 

- test a sample representative of flight parts 

- use results to bound flight performance 

Least restrictive model is binomial 

- Assumes only that all parts from same 
distribution 

- Makes no assumptions about distribution 
of parts (failures, parametric changes, etc.) 

- Outcome is binary (Pass/Fail), 

• defines success probability, Ps and failure 
probability Pf=l-Ps 

- May be only choice when failure 
distribution highly uncertain 

Lack of guidance for derating and large 
sample size requirements provide 
incentive to adopt more restrictive model 

- Restrict population to a well behaved 
subset or "Lot" 

- Normal or Lognormal often assumed 



• Disadvantages of binomial sampling 

- No guidance on effectiveness of 
derating/increased margin 

- Requires large samples (e.g. 22 
samples for Ps=90% @90% 
confidence level (CL)) 
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Conventional model forTID RHA 




• Conventional TID RHA assumes "lot" is well behaved and unimodal 

— Wafer diffusion lot usually (not always) shows homogeneous performance 

- Assuming Normal distribution Sample mean and variance converge to population values rapidly 

- Can use one-sided tolerance limits— KTL(Ps, CL, n)— to bound performance and ensure success 
probability Ps with confidence CL for a test sample of size n 
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Ibias (nA) 


Distribution Pathologies do Occur 



OP484 Ibias Prerad and 100 krad(Si) 


NES 2N5019 After 1 Mrad(Si) 



• Analog Devices (ADI) OP484 shows 
bimodal response even in same wafer lot 

• Similar bimodal response seen in 
National Semiconductor LM111 (Kreig et 
al. NSREC 1999) 


• Some devices show thick tails 

• NES 2N5019 Junction Field Effect 
Transistor (JFET) showed high variation 
in IGSS after 0.3 and 1 Mrad(Si) (x-axis is 
logarithmic) 

• ADI AD590 also shows thick tail 
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When There's No Lot-Specific Data 


Historical Data— Test data for the same part type/# as the flight parts, taken under 
similar application conditions 

Similarity/Process Data— Test data for parts with similar function fabricated at the same 
facility in the same process, taken under comparable application conditions 

Heritage Data— Data regarding past flight use of the same part type/#; heritage mission 
environments must usually be at least as severe as the current mission and application 
conditions must be comparable 

When you are really desperate 

- Physics— What do we know about the part and the radiation effects mechanisms that can 
place limits on their severity— example: Silicon-on-lnsulator (SOI) limits SEE susceptibility 

- Technology trends— How have the susceptibilities changed over previous "similar" 
generations— e.g. SEL susceptibility for commercial SRAMs with minimum Complementary 
Metal Oxide Semiconductor (CMOS) feature size from 0.35 down to 0.11 microns 

- Technology generation— Susceptibility and trends thereof for comparable technologies from 
the same and even other vendors 

- Expert opinion— What do the smart kids think? 

None of these lines of evidence may restrict susceptibility in a meaningful way 
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Structure of Constraining Data 
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SEE Risk Data Structure 
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Data Structure for TID RHA 


Flight Part TID Performance 

l 



This level equivalent to 
conventional TID RHA 
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in failure probability, 
not consequences. 
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Two Types of Probability 


• Physical probability 

• Indeterminacy is inherent in process; 

• no amount of additional data will 
change your odds for betting on 
outcome 

• Subjective probability 

• indeterminacy reflects our limited 
knowledge 

• probability can change as our 
knowledge increases 

• Analogues to RHA 

• Probability of observing an SEE for a 
particular ion is physical 

• Probability our lot has a majority of 
parts that will meet mission 
requirements is subjective 


Physical (or Objective) Probability 


Beta Decay of a Neutron 
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Bayes Theorem: 


Bayes' Theorem 



P(Model | Data) 


P pr (Model)P(Data|Model) 

I P pr ( Model) P( Data |Model) 

Models 


- P pr (Model)=Prior is probability of our 
model before we consider new data 


- P(Model|Data) is updated (posterior) 
probability — the probability that takes into 
account data AND prior expectations 

- Denominator ensures normalization, but is 
also a measure of probability for all models 

Bayesian probabilities are subjective 

- Depend on our knowledge at the time of 
calculation 


- Can change as we add new knowledge 

- May be associated with a “confidence” 

Bayes Theorem is the most efficient way to 
update probabilities given new data 


P(Data|Model) is likelihood, L 
L=P(X1)*P(X2)*P(X3)*P(X4)*P(X5) 


Thomas 

Bayes 



XI X5 X2 X4 X3 


Data {XI, ...X5] drawn at random. 
Candidate model is P(X) above. 
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Bayesian Approach to RHA 
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3 Heads 
In 

10 Tosses 


Effect of Prior and Likelihood 





Probability (P(Heads)) for different Priors as data increases 
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Minimizing Subjectivity 



• Uninformative Priors— Broad, slowly varying (flat) Priors give rise to 
Posterior distributions that reflect the data (likelihood) 

- If Prior is 0 anywhere, Posterior also 0 there (impossible means impossible) 

- Some Uninformative priors (for discrete distributions) are called Maximum 
Entropy priors 

• Empirical Bayes allows looking at the data before developing Prior 

- Can locate Prior at the maximum of the likelihood and make it very broad 

• This means you think the likelihood probably gives the best guess for the best fit, 
but allow for significant sampling error 

• Usually yields good results unless there are serious sampling or systematic errors 

• Some Bayesians refer to this as "cheating" 

• Maximize the data to update the Prior and dilute its influence. 

• Also, you don't have to try only a single Prior— you could even attach prior 
probabilities to your priors if you want to go really meta. Or you could try 
several Priors just to gauge the dependence of results on the Prior. 
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Data Sources 


Table I: SET Data for ADI and Linear Technology (LTC) Op Amp Table II: SEL Data for ADI 0.6 pM CMOS ADCs and DACs 



Vendor/ Process 

SET Rate 
(day 1 ) 

WC 

duration 

WC 

amplitude 

Supply— Output 

RH108[2] 

LTC— RH Bipolar 

0.011 

7 ps 

4.5 V 

0/12V — 6V 

RH118[2] 

LTC— RH Bipolar 

0.046 

>5 (LIS 

2 V 

-8V/+8V— 0V 

RH1014[2] 

LTC— RH Bipolar 

0.029 

>35 ps 

rail-to-rail 

-12V/+12V — 6V j 

RH1499[3] 

LTC— RH Bipolar 

0.0082 

13 (LIS 

4.4 V 

-15V/+15V — 4V 

RH1078[4] 

LTC— RH Bipolar 

0.04 

30 ps 

2 V 

0/10V— 2V 

OP27[5] 

ADI — Bipolar>2.5 pm 

0.036 

10 (LIS 

10V 

-10V/+10V— varied 

OP113[2] 

ADI— Bipolar>2.5 pm 

0.01 

>2 ps 

1.7 V 

0/5V— 2.55V 

OP270[2] 

ADI — Bipolar>2.5 pm 

0.35 

1.2 (LIS 

3 V 

-5V/+5V— 0.42V 

OP400[2] 

ADI— Bipolar>2.5 pm 

0.56 

10 ps 

3 V 

-12V/+12V — +2.4V 

OP05[5] 

ADI — Bipolar>2.5 pm 

- 

12 (LIS 

— 

— 

OP15[5] 

ADI— Bipolar>2.5 pm 


15 ps 

- 

- 


Single-event transients (SETs) depend on 
application conditions. Data here correspond to 
worst-case transients for the device. Worst-case 
SET rate and duration can be modeled as lognoral 
distributions for op amps across the ADI 
bipolar>2.5 micron and LTC RH process. WC 
amplitude can be modeled as a beta distribution, 
but assuming rail-to-rail transients is not overly 
conservative. 


j Part # 

Process 

Onset LET 
( MeVcm2/mg) 

Test 

Facility 

tflim (cm 2 ) 

AD5305 

0,6 um 

LETdl 

BNL 

?? 

AD7472 

0,6 um 

IKLFRIS 

BNL 

5.00E-04 

AD7476 

0,6 um 

LET<60 

BNL 

?? 

AD7664 

0,6 um 

6 

BNL 

2.50E-04 

AD7714 

0,6 um 

15<LET<24 

BNL 

6.00E-04 

AD9260 

0,6 um 

8 

BNL 

?? 

AD5334 

0,6 um 

5 

TAMU 

5.00E-04 

AD7664 

0,6 um 

4 

TAMU 

1.00E-03 

AD7675 

0,6 um 

4 

TAMU 

3.00E-05 

AD7714 

0,6 um 

20<LET<22 

TAMU 

1.00E-04 


SEL saturated cross sections vary too widely 
to model SEL rate as a compact distribution. 
Onset Linear Energy Transfer (LET) appears 
to be bimodal, but we can model the lower 
mode as a lognormal to determine worst 
case (WC) onset LET for SEL in a process at 
a given confidence level. 
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Single-Event Transient (SET) Rate Priors 
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SETs rates for ADI OP series bipolar feature 
size>2.5 |um op amps are distributed roughly 
lognormally across the family with lognormal 
mean=-3 and standard deviation=0.45. The 
90% softest part would have ~0.089 SETs/day, 
or with 90% confidence <0.19 SETs/day. 


The best-fit lognormal to SET rates across 
LTC RH Series op amps had lognormal 
mean=-3.8 and lognormal standard 
deviation= 0.65. The 90% softest part 
would show ~0.027 SETs/day or with 90% 
confidence <0.13 SETs/day. 
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Probability 


SET Duration Priors 



0,014 

0.012 

0.01 
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0,004 

0,002 

0 



0,016 
0,014 
0,012 
£ o,oi 

f 0.008 
i . 0.006 

0,004 

0-002 

0 



SET durations in ADI and LTC op amps can also be modeled as a lognormal, yielding 
best fit mean and standard deviation and the results used to bound SET duration to 
any desired confidence level (See Table III.) These results can be used to select parts 
or for purposes of filtering transients in a design 


Table III: Bounding SET Widths for ADI and LTC Op Amps 


Process 

Typical 

90% WC 

Typical @90% CL 

90%WC@90%CL 

ADI 

15 ps 

<35 [is 

143 ps 

<218 ps 

LTC 

22 ps 

<35 ps 

75 ps 

<170 ps 
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Probability 


SEL Onset and Heritage 


0,02 -T Prior for $ EL Onset LET for ADI 0,6 ftm CMOS (lower mode) 


0,016 


0.012 


0.003 


0.004 



0,29 
0 , 23 ^ 


L ° 8rto *k^t vf ^ l.« 


0 . 17 ,,^ 
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30 
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— Minimum from CREME-96 


FOM Estimate 


— Maximum from CREME96 


Polar , 
750 km, 98° 



Space Station , 
500 km, 51.6° 


SEL cross sections vary too much across parts in 
a process to model rates. However, onset LET for 
SEL for ADI's 0.6 jum CMOS ADCs and DACs seems 
to fall into two compact modes. To bound the 
onset LET, we model the lower mode as a 
lognormal. With 90% confidence, onset LET for 
parts in this process should be >2.7 Mev-cm 2 /mg. 


Heritage is often proposed en lieu of 
testing to qualify a component/system. If 
heritage environment differs from mission 
environment, each heritage year can be 
weighted by the ratio of the heritage SEE 
rate to the mission SEE rate. However, this 
ratio depends strongly on device geometry 
if the heritage and mission environment 
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TID Degradation of Bipolar Junction Transistor (BJT) Gain 

• Rad. Performance (RP=Gain(Prerad)/Gain(Postrad)) for every part (1<RP) 

• Part-to-part variation: Each lot has a mean and a standard deviation, usually 
determined by Radiation Lot Acceptance Test (RLAT) 

• Lot-to-lot variation: Look at how lot means and standard deviations vary 



- A lognormal distributions of means with a lognormal mean and standard deviation 

- Lognormal distribution of standard deviations (two parameters) 


• Part-type-to-part-type: each lot-to-lot parameter now a distribution 

- 8 parameters describing part-to-part, lot-to-lot and part-type-to-part-type variation 


a) 


b) 


RLAT Data for lot / of part type i 

{RP 1; RP 2/ ... RP^LfN (RPpmpSij) 

Historical Data. Part-Type i (£>3 lots) 

1) {m u ,m i2/ m ik }~ N ( m u rn mi ,s mi ) 

2 ) 

Vsi> &si) 


C) 



Similarity Data summarizes variation over part types 

Variation of avg. m m over part type* 
Variation of avg. over part types 
LO I cr sm ) Variation of avg. over part types 

<t s ,}~LN( <t ot ) Vari at i on of avg. a s over part types 


a) Variability of radiation performance (RP) for a lot j of 
part type / is assumed to follow a Normal distribution (N) 

with mean and standard deviation Sy. b) We 
summarize variability across lots for part type / by fitting 

the lot means to a Normal distribution with m mi and s mi 
as parameters and the standard deviations to a 
lognormal (LN) with parameters ju sj and cr si , since 
standard deviations are positive definite, c) Likewise, we 
can summarize variability over similar part types in the 
same process by fitting the historical parameters to 
Normal or lognormal distributions as indicated. 
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Prior Distributions for Variability in Semicoa NPNs 
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Fig. 3. Prior probability distributions summarize (a) the expected gain degradation and the standard 
deviation about that mean for an arbitrary Semicoa NPN BJT as well as (b) the variability of those 
quantities from lot to lot. 
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Prior Distributions for Variability in MS-L PNP 
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Fig.4 GDF Priors for a generic Microsemi-Lawrence (MS-L) PNP after 300 krad(Si) for operation in the 
“middle” of the device’s current range. Despite the fact that the transistors for the Prior have different 
voltage and current characteristics, the Priors place meaningful constraints on expected gain degradation. 
However, lot-to-lot variation is less well constrained, especially for part-to-part standard deviation. 
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What If There's No Data to Update Priors? 

• Consider probability distribution for expected mean degradation 

HaVe l*(®m ! ®mni ! ^mm) BtlCl P nun (®nim ’ ^mm ) 

- Can select most probable value of m mni and s mm based on p mm ( m m m> s mni) 

- Alternatively, can treat m mm and s mm as nuisance variables and integrate over them to 
find an average or expected probability distribution for POi^) — the expected mean for a 
generic mean degradation of a generic transistor type in this process 

( P ( m m )) = { P ( m rn > m mm » S mm ) P mm ( m mm > S mm ) dm mm ds ,„m 

- Similar operations possible for all lot-to-lot parameters and can be repeated to yield 
expected degradation for a generic xster in a generic lot for a generic xster in process 

Over 90% of PNP xstrs from MS- 
Lawrence would have mean lot gain 
degradation factor<2.1. 

Repeating for other parameters: 

Gain of the 99% WC part from the the 
90% WCPNP in the MS-L process should 
degrade <3x after 300 krad(Si). 
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It's Not Bayesian if You Don't Update the Prior 


For SEE, weight of heritage mission 
depends on environment 

- 1 st order: Ratio of Figure-of-Merit coefficients 
in heritage and mission environments 

- Also depends on details of charge collection 
volume in device— and difference can be 
much larger if heritage and mission radiation 
environments differ dramatically 


Without test data, must update Prior 
w/ heritage data 

For TID, we only know mission i parts 
worked after exposure to dose D t 

L = fld-P(A)) 

i=l 

- D t s must be lower bounds 
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Rate (dy' 1 ) 


Fitting SEE Data 



• For small event counts, use fit that 
considers Poisson errors 

• Generalized linear model: 

n 

L = ]^[ Poisson (n° bs ,|i i ) 
m = x WeibulKLET, - LETO, W, s) 


• If Poisson errors negligible, use exact fit 

• Least squares not optimal @ low LET 

• Least log-squares (LLS) may be better 

LLS = X F i pred x (logF pred - log F / :,bs ) 2 

i=l 


• Solve for asat, LETO, W and s that 
give best fit or WC rate at desired 
confidence level 

• Can use any model to predict |LXj 



• LLS gives better fit near-threshold 
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Statistical Models for Destructive SEE 
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• Single-event latchup (SEL) 

-parasitic bipolar effect in CMOS 

-Can sometimes get several SELs 
per device before failure 

—Recovery very disruptive 
-Also seen at cryogenic temp. 
-Latent damage possible 

• Rate estimation trouble: 

- poor statistics 

- Dataset may include many 
devices w/ varying susceptibility 

- depends on Energy + LET 


• Single-event burnout (SEB) 

- parasitic bipolar effect 

- Similar events seen in FLASH, 
bipolar ICs, Schottky diodes 

- Can get several SEBs per device 
for discrete xstrs, but not for 
other device types 

• Rate estimation difficult: 

- poor statistics 

- Dataset may include many 
devices w/ varying susceptibility 

- Complicated dependence on 
energy, angle and ion species 


• Single-event Gate Rupture 
(SEGR) depends on gate oxide 
and charge transport 

—Always destructive 
-Precursor events damage oxide 

-Single-event dielectric rupture 
(SEDR) somewhat analogous 

• Rate est. complicated by 

- poor statistics 

- Dataset may include many 
devices w/ varying susceptibility 

- Complicated dependence on 
energy, angle and ion species 
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GLM Approach Applied to LTC RAD1419 
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Can estimate rate for a given confidence if statistics adequate for each part. 
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Limitations of GLM for Destructive SEE 



• GLM technique works well when statistics accumulated for each test device 

- Allows bounding of rate for a given confidence level 

- Flexible and can be adapted to include other sources of error 

- Model need not be standard Weibull rectangular parallelepiped 

• Could even be Monte Carlo output for several geometric models of sensitive volume 

• Unfortunately, for some device types, every event kills a part 

- SEGR is always destructive to power Metal-Oxide-Semiconductor Field Effect 
Transistor (MOSFET) as are failures in FLASH, bipolar microcircuits and diodes 

- Accumulating statistics done over several parts 

• How do you detect/treat part-to-part variation 

• Even if statistics gathered for each device, susceptibility can change w/ time 

- TID can alter susceptibility 

- Latent damage due to overcurrent (SEL, SEB, etc.) or bus contention due to SEE 

- Complex devices may have different susceptibilities during different 

• How do we deal with Poisson error, part-to-part variation and time 
dependent susceptibility— possibly all at the same time? 
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What Can We Tell form Statistics of DSEE? 

Poisson Distribution 



• Poisson DSEE^ Failure fluence, F FA)L 
follows exponential distribution 

- Variability insignificant -^single mean 
for all parts, so F fa , l follows single 
exponential 

- Significant variation — > F fa , l follows 
mixture of exponentials, or 
hyperexponential distribution 



• Hidden Markov process— F fa , l 

distribution depends on part selected 

• Compare distributions characteristics 
of F fa , l across parts 

- Mean/Std. Deviation, skew, kurtosis, Range 

- For details, see presentation from 2012 
SEE Symposium, "Assessing Part-to-Part 
Variation for Destructive Single-Event 
Effects" 


Exponential and Hyperexponential 
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Detecting variability in MOSFETs* 


2SK4219, Low-E Kr ions, VDS=100, VGS=-10 HGOK, High-E Kr ions, VDS=100, VGS=-10 




• 2SK4219 MOSFET shows more failures at low fluence than expected for exponential 

- Comparison of distribution characteristics: mean/Std. Dev, skew, range, kurtosis 

- Shows 6% probability of purely exponential behavior 

• F FA | L for HGOK MOSFET shows better fit to exponential 

— Comparison of distribution characteristics shows significance only at 71% level 

*Data courtesy of Veronique Ferlet-Cavrois, See IEEE TNS vol. 59, pp. 2920-2929 
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For MOSFETS Failing During PIGS Test 


Often for VGS=0, MOSFETs do not fail 
during irradiation, but during Post- 
Irradiation Gate Stress (PIGS) test 

- Evidence of latent damage, and failure 
imminent 

Fp A | L unknown, but can be estimated if 
some but not all parts fail at fluence F 

- Assume failure probability binomial 

- PFAIL~^FAIL/^TEST~^" eX P("l"/ '(0) 

- For 2SK4219, <F Fail )~3140 cm 2 , w/ 90% CL 
from 1599 to 5735 Xe ions per cm 2 

- For HGOK, < F Fail )~15500 cm 2 , w/ 90% CL 
from 9000 to 25000 Kr ions per cm 2 

- Note that this is not necessarily the same as 
the SEGR (F) 



Rank 



Rank 
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If We Can Model Fluence to Failure 



• Assuming we accumulate m f events at LET i? (example model: RPP Weibull) 

n m, -1 

£ = nil 1/F i ( LET i ) ex P(- p i ' F i ( LET i ). F i ( LET i ) = 1/ x [Weibull(LET - LET 0 , W, s] 

i=l j=l 

- Initially assume F, the same for each event j accumulated for LET i? 

• Compare likelihood for each LET — a dramatically poor fit may indicate that expected 
fluence to failure has changed from event to event 

- May be due to multiple parts, latent damage, change in vulnerability due to new operation. . . 

• Can introduce models of variability to better match results given enough data. 

• Models for F Fail much more complicated for 

- SEL — F Fail (LET, Range) 

- SEGR and SEB — F Fail (Z, Energy, Angle) 

— May be possible to simplify radiation environment in terms of Equivalent LET 

- F Fail could be mean values of F Fail for Monte Carlo simulations done over 
different candidate models of the sensitive volume 


Presented by Ray Ladbury at the Hardened Electronics and Radiation Technology (HEART) 2014 Conference, Huntsville, AL, March 17-21, 2014 
and published on radhome.gsfs.nasa.gov. 


34 


Conclusions 



• Statistical models are inherent to current RHA methods; some examples: 

- Use of one-sided tolerance limits for TID 

- Guidance for event counts in SEE testing 

• Models to date tend to concentrate on "ideal" or most representative data 

— Assumption that TID performance in a wafer lot follows well behaved distribution 

- Assumption that part-to-part and lot-to-lot variation of SEE response is negligible 
— SEE counts sufficiently high that Poisson errors don't affect SEE rates 

• Much more data less than ideal (similarity, heritage, historical...) 

- Often used for a "warm fuzzy" 

- Bayesian methods here allow quantitative bounds to be placed on radiation response 

• Statistical techniques very promising for bounding destructive SEE 

- May be very important if commercial hardware being used 

- Destructive SEE must be rare, or hardware will not meet requirements 

• Rare events are inherently difficult to bound 

• Proper use of statistics essential for reliable economical space systems 

- Any fool can lie with statistics— Experts use them to expose the truth 
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